An EPIC Tale of the Quiescent 
Particle Background 


S.L.Snowden & K.D.Kuntz 


Mostly K. D. Kuntz 


Extended Source Analysis Software 


Use Based Empirical Investigation 
¢ Builds quiescent particle background (QPB) spectra and images for 
observations of extended sources that fill (or mostly fill) the FOV — 
1.e., annular background subtraction won’t work 
¢ Uses a combination of Filter Wheel Closed (FWC) and corner data 
to capture the spectral, spatial, and temporal variation of the 
quiescent particle background 


New Work: 
¢ Improved understanding of the QPB (aided by adding a whole lot 
of data since 2008) 


¢ Significantly improved statistics (did I mention a LOT more data?) 
¢ Better characterization and identification of anomalous states 

¢ Builds backgrounds for some anomalous state 

¢ New efficient method for non-anomalous states 
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Corners 


Review of Current (Original) Method 


FOV of Filter-Wheel-Closed 


Observation 
interest Data 


really poor stats 


FWC FOV 


background = observation corner 
Bt FWC corner 
poor stats 


Where all of these quantities are spectra... 
...and typical values are ~5x10°!3 /pixel/energy bin/s 
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Current Method 


However, the corner data from an individual observation 
have very poor statistics! 
So, we: 
¢ Build a database of corner data from all observations 
¢ Characterize the shape of each spectrum 
¢ The (2.5-5.0 keV)/(0.4-0.8 keV) hardness ratio 
sufficient 
¢ Then for any given observation 
¢ Measure hardness ratio (red dot) 
* Can sum all spectra with similar . 
spectral shape (points between 
green lines) 
¢ This “augmented” corner spectrum = __ 
has significantly better S/N! 
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Current Method 


Corners 


— 


FOV of Filter-Wheel-Closed 


| Observation 
interest Data 
Now really good stats 
FWC FOV 


background = augmented corner 
& FWC corner 6 
poor stats 


Where all of these spectra are created on chip-by-chip basis 
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Why so Complicated? 


Why not just one background spectrum? 


Mean Quiescent Particle Background 


Spectra are composed of lines and continuum 

¢ [Lines are sensitive to ewsidual gain variation so should 
be fit in the observed spectrum rather than subtracted 
(not ESAS) 

¢ The continuum is characterized by total count rate (R) 
and the (2.5-5.0 keV)/(0.4-0.8 keV) hardness ratio (H) 
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The QPB Varies 


Filter-wheel closed (FWC) “continuum” data shows 
some spatial variation 1n count-rate and 
significant variation in hardness ratio (MOS1&MOS2) 


Hardness ratio (H) for the MOS1, MOS2, and pn (H-meanH) 
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The QPB Varies 


Corner data show: 
¢ Long-term temporal variation due to solar cycle 
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¢ Temporal variation in hardness ratio 
¢ Anomalous states in chips 1-4, 1-5, 2-2, & 2-5 
¢ As of 2008, apparently also in non-anomalous chips 


Cal/Ops 4/17 


The QPB Varies (as of 2008) 


Corner data show: 

¢ [Long-term temporal variation (due to solar cycle) 

¢ Temporal variation in hardness ratio 

¢ Anomalous states in chips 1-4, 1-5, 2-2, & 2-5 

¢ Apparently also in non-anomalous chips 
¢ e.g., distribution of measured hardness ratio” 
¢ was broader than expected oe... . 
¢ from Poisson statistics after Model 
¢ anomalous states had been 80) 
¢ Removed 

¢ Spoiler: Our understanding of 

this last point has changed! 40) 


Number 


Hardness 


Anomalous States 
¢ Some chips show an intermittent low-energy “noise” 


feature 
¢ Typically seen as: 
¢ higher than usual count rate 
¢ lower than usual hardness ratio 
¢ States identifiable in plots of hardness ratio vs. count rate 


we Ge ‘ 


7 
4 | 
a ] 
p* .— f —_— a > Oe ee ad 
’ . g _ 
Vs oo 
_ ~ —) — = -~ 
_ = 
- Se} 
, = i: | —- pw oad 
>> la toa 
" 
iy ee ed +, 
bo , ete —ae ate wt or mwas r* ag 
i 
bad aw 
- .2- 
“eS ae Pe — ee < + J 
_—— 
’ 
| . er. a “ d 
*)> 
—_ ies ee ong te ee, — - 
ae 
ON OTS ce, a ely s Pegg enna oy ae 


ry 4 
tenant rvnenonctnpanageemmtnpaenenpesyesllthtobs 
ry ~ 


a ‘J. 5) 
le ee whale od. 


Cal/Ops 4/17 


So What’s New’? 


Start With: 


Perennial ESAS Tasks 


To keep ESAS up to date, periodically 
¢ Update FWC data (no longer a Goddard responsibility) 
¢ Update databases of corner spectra 
¢ Reprocess as SAS defaults/procedures change 
¢ Check for significant changes in behavior 
¢ Update anomalous state definitions 


Original methods described in Kuntz & Snowden (2008) 


¢ Irregular updates every several years 
¢ Finishing up(?) last(?) significant change (2017) 


Cal/Ops 4/17 


Perennial ESAS Tasks 
Compare 2008 and with 2017 for corner data sets 


Instrument VAW Us} 2017 
MOSs1 42.2 Ms 303.1 Ms 
MOS2 44.4 Ms 303.8 Ms 

on — 36.2 Ms 
Observations ~2200 ~12230 


¢ Significant increase in statistics! Due to 
¢ Increase in number of public observations 
¢ Change in construction of MOS corner data sets 


In 2008 flare removal done before extracting corners. 
However - corner masks block soft proton flares. 
Only filter out periods of high background 1n corners 
(typically entry to/exit from particle belts) 
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With More Statistics - Changes 


¢ With greater number of observations 
¢ Come greater number of extreme states observed 
¢ Even for chips w/o anomalous states 
¢ Had proposed “pseudo-anomalous’ label 

¢ However, no clear “noise” feature 

¢ Statistics may not be sufficient for good background 


PSiica 
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With More Statistics - Changes 


¢ Prompted to revisit issue of distribution of hardness ratio 
for chips with no anomalous states 
¢ Find that the distribution 1s consistent with a single 
mean spectrum and counting statistics for most chips 
¢ Non-anomalous states of 1-4, 1-5, 2-2, 2-5 not so clear 
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A success story — non-anomalous MOS! CCD #3 
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With More Statistics - Changes 


¢ For most chips a single mean corner spectrum is sufficient 


Observations with extremely low hardness ratios may 
not be well modeled with a mean spectrum but 

Most (non-anomalous) observations with very low 
hardness ratios are short - so a problem anyway 


observed distribution 
simulated distribution 


PSiica 
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With More Statistics - Changes 


¢ This is a significant change from ESAS V1, only possible 
¢ With the greater statistics 
¢ Better definitions, identification and removal of 
anomalous states 


¢ However the method used in ESAS V1 still applicable to 
observations/chips in anomalous states but... 
¢ Do we know enough about the anomalous states? 
¢ Maybe 
¢ Do we have sufficient statistics to implement? 
¢ Maybe 
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Anomalous States 


3,0 3,0 


Comparison of hardness ratio/rate diagrams and mean 
spectra as a function of hardness ratio show no clear 
boundary between anomalous and non-anomalous states. 
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Anomalous States 
model distribution for H 


—__ tor Poisson stats for mean - 
non- ean e spectrum — 7 — 


4 
3 
—soe \o 
j ceed 3. 
— en ©, ae ol 
a = > 
7 are! ——, _? 
— ——— —— wee et » 
te eee 2 £ 
re - etching 26 
—— ~— YA 
—~) ~~ — at 


8 


fnaran 


model distribution for H 
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The atc of 7" —— ratio Hi is consistent wiles a 
mean non-anomalous spectrum given Poisson statistics... 
but the distribution of H 1s not consistent with a single mean 
anomalous spectrum 
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Anomalous State Questions 


¢ Ata given value of H are some observations in 
anomalous states while others are not? 
¢ Seemingly not 

¢ What governs the strength of the noise feature in the 
anomalous states? 


¢ Do anomalous states evolve? 
¢ Have not seen anomalous states in chips other than the 
four identified in K&S 2008 
¢ Possible evolution for a single chip? 


Change in mean 
—— H with time? 
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Anomalous States 
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Structures in the noise features do not change 
significantly with hardness ratio 

Thus may be able to construct backgrounds for 
anomalous states where there are sufficient data. 
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So What About the pn? 


pn Issues 


¢ Given the longer read time of the pn, OOT events a more 
significant problem 
¢ Corner data will be strongly contaminated by the 
spectrum within the FOV 
¢ Thus corner data can be strongly contaminated by 
soft proton flares 


¢ Therefore need to do flare cleaning before corner 
extraction 
¢ Flare removal a very hands-on process 
¢ Prospect of handling 12000 observations daunting 
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Flare Fitting Issues 


For region of interest, form light-curve in 2.5-8.5 keV 
Create histogram of values 1n light-curve 

Fit Gaussian to peak 

Remove time steps with values >30 from mean 

For strong flaring - fit may fail in a number of ways 
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Flare Fitting Issues 
¢ Using a training set of ~2000 observations where the fits 
were evaluated by hand 
¢ Built anew fitting algorithm and residual measures to allow 
completely automated evaluation of the goodness of fit. 
¢ Of 10216 observations only 3773 had good flare filtering. 
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pn Issues 


¢ To test goodness of flare filtering for corner data created 
mean corner spectrum for each FOV filter 


¢ Here, 
¢ corner = corner data - scaled corner data from randomized data 
¢ If flare filtering good, expect all spectra to be the same, 


but that was not the result 


Thin 
Medium 
Thick 
Closed 
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pn Issues 


¢ Source of variation with filter: 
¢ Is it due to real problems with flare removal? 
¢ Is it due to problem with scaling and removing OOT? 


Thin 
Medium 
Thick 
Closed 
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pn Issues 


¢ Source of problem unresolved — however 
¢ Sort the spectra by hardness ratio and remove all that 
are more than 30 different from spectra with same 
hardness resolves issue (slight over-simplification) 
¢ Only 1966 observations remain 


Thin 
Medium 
Thick 
Closed 
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pn Issues 


¢ Consider the distribution of the hardness ratio of the 
remaining corner spectra (done quadrant-by-quadrant) - 

¢ The distributions are consistent with a mean spectrum 
and counting statighiCs | Quad s | Quad-2 
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Summary 


¢ Newest reprocessing increases the amount of data for 


study of the background by >6X 
Significant changes to the way ESAS works 


For non-anomalous MOS chips and the pn use the 
mean corner spectrum 

For anomalous states use the ESAS v1 augmentation 
scheme of finding corner spectra with the same spectra 
shape as that of the observation of interest 


Still significant doubts about anomalous state spectra 
and non-anomalous state spectra with extreme values 
of the hardness ratio 

Will construct backgrounds for those chips but 

By default will produce warning and will not include 
in the total background spectrum 


Cal/Ops 4/17 


Future? 
Reconsider the construction of FWC FOV/FWC corner part 
of the equation 
FWC FOV 


back d= ——__ 
oseroe FWC corner 


augmented corner 


in order to find ways of increasing the S/N 


Spectral model of the QPB continuum and lines for use in 
simultaneous fits of background and source. 


And, as always, periodic updates of corner spectra databases 
and anomalous state definitions 
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